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(57) Abstract 

A recommendation process includes the con- 
sideration of the compatibility of the items to 
be recommended. An electronic processing sys- 
tem for generating a compatibility-modified rec- 
ommendation output includes a processing sys- 
tem of one or more sets of processors config- 
ured to receive applicable data including i) item 
recommandation data, and ii) item compatibil- 
ity rules, and to modify the item recommanda- 
tion data using the item compatibility rules to 
produce a compatibility-modified recommandation 
output set. A method of producing a compati- 
bility-modified recommandation includes receiv- 
ing applicable data, including i) item recomman- 
dation data, and ii) item compatibility rules, and 
modifying the item recommandadon data using the 
item compatibility rules to produce a compatibil- 
ity-modified recommandation ou^ut set. 
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SYSTEM, METHOD AND ARTICLE OF MANUFACTURE 
FOR PRODUCING ITEM COMPATIBLE RECOMMENDATIONS 

Related Applications , . , , . . 

This application is related to the following U.S. patent and patent 
applications, which are incorporated by reference: „ . • — jo' 

1. SYSTEM, METHOD AND ARTICLE OF MANUFACTURE FOR USING , ■ 
RECEIVER OPERATING CURVES TO EVALUATE PREDICTIVE UTTLITY. U.S." ' 
Patent No. 5,842,199. - J^ : 

2. SYSTEM, METHOD AND ARTICLE OF MANUFACTURE FOR UTILIZING ■ 
IMPUCrr RATINGS IN PREDICTION INFORMATION SYSTEMS, filed October 8, V 
1996, serial no. 08/725,580. 

15 3. SYSTEM, METHOD, AND ARTICLE OF MANUFACTURE FOR GENERATING . 
IMPLICIT RATINGS BASED ON RECEIVER OPERATING CURVES, filed October ' 
8, 1996, serial no. 08/729,787. r o a 

4. SYSTEM, METHOD AND ARTICLE OF MANUFACTURE FOR INCREASmG 
20 THE USER VALUE OF RECOMMENDATIONS MADE BY A RECOMMENDER 

SYSTEM, filed July 17, 1 998, by P. Bieganski, application serial no. 09/1 1 8,025. 

5. SYSTEM, METHOD AND ARTICLE OF MANUFACTURE FOR MAKING 

25 HIGH USER VALUE RECOMMENDATIONS, filed July 17, 1 998, by P. Bieganski, 
^plication serial no. 09/1 1 8,026. 



Background 

The present invention relates generally to data processing systems, and 
30 more particularly, collaborative filtering and recommender systems. 

Recommender systems predict the preferences of users based on 
attributes known about the user or a past history of preferences or consumption by the 
user. For example, a recommender system may predict that a user will like the movie 
"Titanic" because he previously indicated a liking for such other epic movies as 
35 "Lawrence of Arabia" or "Ben Hur". 

Present recommenders focus on making accurate recommendations of 
user preference. However, the most accurate recommendations, in isolation, may be 
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the wrong items when considered collectively as a set of recommendations aid as 
recommendations designed to accompany products that the user is buying or has 
bought. For example, a system recommending books may discover that a particular 
customer woidd wijoy Tolkien's The Hobbit, based on other books that the user did and 
did not like. The Hobbit, however, appears in more than thirty editions, from hardcover 
to paperback, audiobook to videocassette. editions bimdled with otherbooks, iid "^^ 
editions illustrated by different illustrators. If the reconunender system were to suggest 
that the customer consider several of these, it would likely annoy the user and waste the - 
opportunity to recommend a more diverse set of books. As important, if we know that 
the customer already owns one edition of The Hobbii, we likely woidd prefer to avoid^' ■ 
reconmiending another edition, so as to add greater value to the bookstore's 
recommendations. Similar examples also occur where having an item makes V . » 
recommending a different item more valuable. For example, a student who has a copy 
of a particular textbook in her shopping cart would be well-served by a recommendation 
for the study guide that accompanies that textbook, even if her prior purchases do not 
independently indicate that the study guide is an item she would otherwise be likely to 
buy. 

A recommender system determines its recommendations by examining 
previous user preference data. The preference data can be unaiy or numerically valued. 
Unary preference data is a set of customer-item pairs: a customer-item pair indicates 
that an event linking the customer to the item has occurred. No additional preference 
information is available to the recommender system about the a user-item event except 
that it happened. The non-existence of a customer-item pair (more generally known as a 
tuple) for a specific customer-item pair does not indicate a preference: it only indicates a 
lack of information. An example of unary customer data is purchase record data where 
a customer-item pair indicates that the customer has purchased the indicated item. 
Another example of unary data is contained in web page logs, where a customer-item 
pair indicates that the customer has visited a specific web page. 

Binary and numerically valued preference data are generally in the form 
of a 3-tuples, where the three elements of the tuple are customer identifier, item 
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idenUfier, and preference value. The preference value indicates, for example, the 
strength of the user's preference for the item or whether the user*s preference is either ^^fjj 
for or against the item. To illustrate, where the preference is represented in binary fonn.T 
a "0" may mean a preference against an item whUe a means a preference for the a 
item. Where the preference is presented as numerically valued data, the data value may 
represent a one-dimensional axis of preference, with the midpoint indicating an : - -tJ 
ambivalent preference for the item, a low value indicating a strong dislike for the item, 
and a high value indicating a strong preference for the item. , ,j 

Preference data may be presented to the recommender system in explicit ' 
or implicit form. Explicit preference data are preference values that a user has supplied ^ 
directly, for example by filling out a survey. Implicit preference data consist of . r r> 
preference values that have been inferred by observing actions that the user has taken. It 
can be inferred that the user has some preference for the item that she has just bought, 
although the act of purchasing the item is not an explicit statement of preference per se. 
A user*s preference for a web page may be inferred, for example, by measuring the 
amount of tirne that the user spends reading the web page, or the number of times the 
user returns to that page. 

The inputs to a recommender system are typically preference values as 
described above. The outputs of the recommender system are predictions of preference 
values for items, particularly those for which the user has not already indicated a 
preference. Like the input values, the output preferences may be unary, binary, or 
numerically valued. A system that outputs unary recommendations predicts items that 
will be of interest to the user, but does not attempt to predict the strength of a user's 
preference for each item. Binary predictions indicate items that are likely to be of high 
preference to the user and items that are likely to be of low preference, but again cannot 
provide an estimate of preference strength. Numerically valued preferences indicate a 
preference for or against the item and also indicate the preference strength. Note that 
the domain of the preference input may be different from the domain of the output 
preference predictions. For example, the preference input may be unary, while the 
output preference predictions may be numerically valued. 



wo 00/39725 PCTAJS99y30356 

While unary and binary preference values do not indicate the strength 6f 
the preference, some recommender systems may additionally rank the preference ' 
predictions being returned such that the highest rank predictions have the largest ' ' ^ 
probability of being correct Numerically, valued items are implicitly ranked/ - ' " 
5 Existing recoriimcndcr systems genierate recommendations by sclwting" ^ ' 

the highest-ranking positive preference values. However, this technique does not " 
always provide a desirable effect. In some cases, there may be strong correlative efifebi& ' 
between a current or past purchase, and a recommendation that otherwise woiild have a '^ 
low ranking. For example, the purchase of 35 mm fihn may rank low on a 

10 recommendation list, or may not even be on the recommendation list, given the cumnt ' 
contents of a shopping basket. However, if there is knowledge in the recommender ' 
system that the user has previously purchased a 35 mm camera, then it becomes more' ' 
sensible to recommend 35 mm film to the user. 

There may also be strong anti-correlative effects that should be taken 

15 into account to remove a recommendation from a recommendation list. For example, if 
a user has purchased a pizza and a bottle of root beer made by one manufacturer, then , 
there is little value in reconuneiiding that the user by root beer made by another 
manufacturer. 

Therefore, there exists a problem with existing recommender systems 
20 that, although able to recommend items with high confidence level, the recommender 
system is unable determine the quality of recommendations in view of other items 
present in the shopping basket, the recommendation set or in an historical set of past 
purchases. Consequently, the value of some of the reconimendations made to a user 
may be low. There is a need to reduce the frequency of occurrence of low value 
25 recommendations. 



Summary of the Invention 

To address the problems listed above, the present invention is directed to 
including compatibility in the process of recommending items to a user. In particular, 
30 the invention is directed to an electronic processing system for generaiting a 
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compatibility-modified recommendation output set to a user based, at least in part, on a 
set of item compatibility rules. The system includes a processing system of one or more 
sets of processors configured to receive applicable data including i)itein * 
recommendation data, and ii) item compatibility rules, and to modify the itmi ^ 
5 recommendation data using the item compatibility rules to produce a compatibility- 
modified recommendation output set 

In another embodiment, the invention is directed to a method of ^ . 
producing a compatibility filtered and weighted recommendation to a user, using a 
computer having a processing system with one or more sets of processors. Tlie method . 

1 0 includes receiving, using the processing system, applicable data, including i) item 
recommendation data, and ii) item compatibility rules, and modifying the item 
recommendation data, with the processing system, using the item compatibility rules to 
produce a compatibility-modified recommendation ou^ut set. 

. In another embodiment, the invention is directed to a computer-readable 

1 5 program storage device, having a set of program instructions physically embodied . ; . 
thereon, executable by a computer, to perform a method of producing a compatibility 
filtered and weighted recommendation. The method includes receiving applicable data, 
including i) item recommendation data, and ii) item compatibility rules, and modifying 
the item recommendauon data using the item compatibility rules to produce a 

20 compatibility-modified recommendation output set 

The above simmiary of the present invention is not intended to describe 
each illustrated embodiment or every implementation of the present invention. Other 
features of the invention, together with a fiiller understanding of the invention will 
become apparent and appreciated by referring to the following description and claims 

25 taken in conjimction with the accompanying drawings. 

Brief Description of the Drawings 

The invention may be more completely understood in consideration of 
the following detailed description of various embodiments of the invention in 
connection with the accompanying drawings, in which: 
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FIG. I illustrates a computer system for use with an embodinienrof the ' 
present invention: > :\:^,i-:3 'i:^: \c.i2^ 

FIG. 2 illustrates a system for generating a compatibility-modiified : ' 
recommendation output set for a user according to one embodiment of the iiiveiitidnr " ' 
5 FIG. 3 illustrates a method of implementing a compatibility' modifier/ 

FIG. 4 illustrates a method of modifying a set of recomin^datioris to " 
produce a compatibility-modified recommendation output set; 

FIG. S illustrates methods for modifying items in a recommendatioh set 
with a recommendation score in a compatibility modifien ^ 
10 FIG. 6 illustrates a compatibility-aware recommendation system ^ " 

according to another embodiment of the invention; - ^ ^ ^^ 

FIG. 7 illustrates a method of implementing compatibility awareness 
within a recommendation engine; 

FIG. 8 illustrates methods for modifying items in a recommendation set 
IS with a recommendation score m a compatibility aware recommendation engine; 

FIG. 9 illustrates data structures and methods for inferring item 
compatibility rules from purchase data; 

FIG. 10 illustrates two call center information systems that receive item 
recommendations, one system being compatibility-unaware and the other including a 
20 compatibility filter, 

FIG. 1 1 illustrates an information system for a commerce center for 
performing electronic transactions; 

FIG. 12 illustrates an information system for a telephone call center, 
FIG. 13 illustrates an electronic system for use with a cash register; and 
25 FIG. 14A and 14B illustrate different processor configurations for a 

compatibility modifier. 

While the invention is amenable to veuious modifications and alternative 
forms, specifics thereof have been shown by way of example in the drawings and will 
be described in detail. It should be understood, however, that the intention is not to 
30 limit the invention to the particular embodiments described. On the contrary, the 
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intention is to cover all modifications, equivalents, and alternatives falling within the . 
spirit and scope of the invention as defined by the appended claims. 

Detailed Descrip Hni^ 

This invention is applicable to recommcnder systems, and is beUeved to 
be particularly applicable to increasing the value of recommendations made by ^ - ■ 
recommender systems. In particular, the invention is believed to be q>plicable to '^^ 
increasing the value of recommendaUons made by existing recommender systems " ^ ^ : 
passing the recommendations through a compatibility modifier to add items to, or 
subtract items fiom, the recommendation list \ L - . 

Recommender systems concentrate on maVIng accurate 
recommendations, but do not take account of the compatibility of a recommendation 
with other items that may be in the shopping basket, in historical purchase data or in the . 
present recommendation set Recommender systems, therefore, would benefit fixjm - ; 
incorporating /re/n coOTpa//6/%. We define item compatibility as the relationships : 
among items that make some items substitutes or complements for other items. 

A substitute relationship exists when a customer generally consumes one 
itein or the otHer, but not both: Example of substitutes include skim miUc and whole 
milk. Most customers do not purchase these items together. We should note that for 
compatibility purposes, substitutes need not actually replace each other in a precise way. 
For example, tofu and bacon may be substitutes for each other if the people who 
consume tofu generally do not consume bacon or vice versa. In the book example, each 
edition of the Hobbit is a substitute for other editions, though the strength of the 
relationship may vary. For example, someone who owns a complete set of Tolkien 
novels is unlikely to buy a separate copy of The Hobbit, but someone who owns only a 
copy of The Hobbit may be wiUing to buy the complete set, since it includes many other 
novels. 

A complement relationship exists when the fact that a customer owns or 
consumes one item generally indicates that the customer will prefer or consume another 
item or set of items. For example, sugar and cream are both complements for coffee, 
and hot dog buns and mustard are complements for hot dogs. Complements may be 
either one-way or two-way. For example, the purchase ofeggs may not indicate a 
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likely purchase of cake mix» but the purchase of cake mix may strongly suggest the ' 
purchase of eggs, since eggs are used with cake mix to make a cake. Other exanipleslif ^ 
complements include film for cameras, batteries for battery— operated toys and 
electronics, and video cassettes for VCRs. Note that some complement relationships 
5 persist for a long period after the product is purchased (eCg., owning a camera leads to a 

long sequence of film purchases), ^le others are more immediate (e.g.,* having bbugjit * ' " 
cake mix in the past doesn't generally increase the future likelihood of buying egg^> In - 
the textbook exanq)le provided above, a study guide is a likely complement for an'" 
associated textbook, and may have a value that persists for a period of time ^ ' ^ = * * 

10 corresponding to the duration of the course of study. . ^ - - - 

A recommendation set is defined as a set of items recommended to a 
user. The reconunendation set may be unordered, in which case the weight accorded to ' ' " 
each recommended item is equal. The recommendation set may be ordered, in which 
case some itenis (generally those at the top of the recommendation list) are 

15 recommended more strongly than others. The recommendation set may include - 
recommendation values associated with each item, in which case the strength with 
which each item is reconunended is indicated by the associated value. 

Rcconmiendation sets may be generated in many wayfc CdmmoW^^ — ^ 
mechanisms include "word of mouth" v^erein a person suggests items to another 

20 person, publication of individual opinions such as movie or restaurant reviews written 
by critics (which often have stars to indicate a reconunendation value); publication of 
collected opinions such as the automobile reliability and movie ratings published by 
Consumer Reports; evaluation by systematic and possibly objective ratings formulas as 
is commonly done for comparative product reviews; evaluation by software systems that 

25 evaluate the contents of the items being considered as is commonly done for 

information retrieval searches such as library and world wide web searchers; and 
collaborative filtering systems that use the opinions of multiple \isers to create a 
recommendation for other users. An interesting case is the use of a recommendation 
engine, which incorporates collaborative filtering, content analysis, or both to automate 

30 the process of generating recommendations. The present invention is applicable to 
reconunendation sets generated in all manners, including those recommendation sets 
generated by reconunendation engines. 
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Compatibility-modified recommendation sets are recommendation sets 
that incorporate knowledge about item compatibility and knowledge about the items that \ 
are already being recommended to, being purchased by» or previously purchased by the 
user. A compatibility-modified reconunendation set may exclude items that would be hT^ 
5 reconunended without compatibility information; it may recommend items that would i i. 
not have been recommended without compatibility information; and it may rebrdei: or : 
assign new recommendation values to items being reconunended. r r rJ x;:^ 

Compatibility^modified rccoinmendation sets provide greater value to ;rv 
the users of a recommendation system. The customer receiving the recommendations ' 

10 receives a set of recommendations that is less likely to recommend items that conflict 

with other items and is more likely to contain items compatible with those items being ;.ic 
purchased, either presently or previously, or being recommended. : . : 

A marketer who uses compatibility-modified recommendations is , v : .: 
provided with a set of recommendations that is more likely to anticipate real customer 

15 interests, and therefore is more likely to lead to successfiil suggestive selling. . - 

The inesent invention is directed to the creation of compatibility^ . t 
modified recommendation sets. It is useful for improving the quality of a 
recommendation set by taking advantage of knowledge of item compatibility,:in the 
form of item compatibility rules, and taking advantage of the knowledge of which items 

20 a customer has previously purchased, is presently purchasing, or are being presently 
recommended to a user. 

The present invention may be used to modify a reconunendation set that 
is provided from any source, or may be employed in a reconunendation engine that uses 
compatibility rules to generate compatibility-modified recommendations directly. 

25 It is important to note that, although much of the description contained 

herein refers to implementations that use a particular form of item compatibility rule, 
namely one-way item-to— item substitution and complement rxiles, the invention is not 
limited to this form of rule. The invention described herein can apply item 
compatibility rules in any form to recommendations. It is also important to note that, 

30 although much of the description contaiiied herein refers to unordered reconunendation 
sets, the invention is not limited to unordered reconunendation sets and may be used to 
modify recommendation sets of any type to improve their value by incorporating 
knowledge about item compatibility. 
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FIG. 1 shows a diagram of a typical computer system suitable for 
practicing the present invention. The computer may include a system of one or moTre' 
central processing units (CPUs) 102, a memory system 104, an input/output (I/O)^^^-"^ ^'^ 
adapter 106, a secondary storage 108, a network interface i 10, a user inter&ce aidapter 
1 14, and a display adapter 1 12. All of the computer components are connected by a"^ *^^"^^ 
system bus 115. The display adapter 1 12 may be connected to a display 1 16 iFor ^''^ 
displaying a recommendation to a user. The user interfoce adapter 1 14 may be' " * fi-:^- : 
connected to a user input device 1 1 8, such as a keyboard, mouse, barcode scanner or the 
like, • - - ^".^^.-^ 

The computer system may include more than one processor, where the 
processors are in different locations. In such a case, the processors may be linked by - ^ 
ii^ut/output interfaces over a network, such as a local area network, wide area network - ~ 
or the Internet. 

In one particular embodiment of the invention, illustrated in FIG. 2, a . 
compatibility modified reconmiendation set 205 is generated by a compatibility - " ' 
modifier 200 that uses a recommendation set 201 and a set of item compatibility rules 
204. The compatibility modifier may also use a shopping set 202 and an historical set • 
203. The generation of the compatibility modified reconmiendation set 205 in this .^-^-'^^ 
embodiment requires the use of the recommendation set 201 and the item compatibility 
rules 204. The shopping set 202 and the history set 205 are optional and may be used in 
any combination with the recommendation set 201 and the item compatibility rules 204. 
The item compatibility rules 204 are used to detem:iine which items should be added to, 
removed fi-om, and changed in the recommendation set 201 to yield the compatibiliQr 
modified recommendation set 205. 

There arc many different ways to detcraaine reconmiendation sets 201, 
shopping sets 202, history sets 203, and item compatibility rules 204. Each of the sets 
and rules is based on a universal set of items that defines the products, services, or other 
goods that customers may buy or own. The universal set of items is extremely flexible, 
and is generally customized for each application. For some retail applications, the 
universal item set exactly matches the products for sale by a particular retailer. In other 
retail applications, the universal item set is augmented to include products that a user 
may have purchased elsewhere that are not sold by the retailer, combinations of 
products that form common sets, or product aggregates and category items such as 

10 
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"Tolkien" for a bookstore or "produce" for a grocery store. Other applications include 
items that correspond to demographic or psychographic properties that a customer may 
possess.: The present inyendon works with all such item sets. For purposes of clarity,- s 
we refer here to the subset of items that may be recommended (usually the same as or ii ' 
5 subset of those for sale) as the r^comm^m/afr/^ //«ms. ; ^ ^ ; 

A recommendation set 201 is a set of recommendations on the ' • 
recommendable items. These reconmiendations may be provided by an outside source ~^ 
or generated automatically using, for example, genetic algorithms, collaborative ^ ^ 
filtering, neural networks, or other statistical models. The recommendations may also ^ 

10 be pre-determined based on vendor specifications, or derived firom human or 

computer-based experts. For example, the recommendation set in a book store may be ^ 
a list of recommended books that employees and book reviewers found interesting. In a ^ 
travel agency, the reconunendation set may consist of hotels and restaurants contained : 
in the travel agency's travel guide. For specific applications where shopping sets and/or 

15 historical sets are used, and for specific users at specific times, the reconunendadon set 
may be empty; an empty recommendation set simply indicates that the system has no 
recommendable items to suggest at that time. An empty set can still be compatibility— 
modified, since the modification may add new items to the s^t^i: 

A shopping set 202 includes items for which the user has indicated a 

20 current intent to purchase or consume. The user's indication may be explicitly declared 
or inferred firom user actions. Examples of ways that a shopping set can be generated 
include, but are not limited to: using the contents of a "market basket" firom an 
Internet-based shopping service; using an active shopping cart that scans the bar codes 
of products being placed in the basket; using the set of items entered into a cash register 

25 at check-out time; and using a shopping list provided by the customer. A shopping set 
may also be generated by observing the customer's behavior. It is advantageous to use a 
shopping set when the value of recommendations provided to the user can be increased 
based on their compatibility with products currently being purchased. Hence, a cooking 
store might use the shopping set at check-out to identify items for suggestive selling, 

30 such as a Chinese cookbook for customers purchasing a Wok. 

An historical set 203 consists of explicit or implicit infomiation about 
the user's possession of and preference for items. The historical set may include a list of 
items selected or purchased by the user in past interactions with the system, or just 
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purchased recently; a list of items that the user owns, whether purchased throughihe ' 
system or elsewhere; a list of user ratings of items, based upon expressed user - ' 
preferences, inferred preferences, or other data. The historical set may also include'a^y 
other set of data that represents information about the user's possession of and ■ " 

preference for items beforc the present interaction wth the system. Historical d^ may,' 
for example, include data gathered from credit card records, marketmg surveys, and 
other commerciaUy available sources of individualized preference data. For example, a ' 
store that sells film and batteries may use Ae historical set to store the types of cameras ^ 
owned by the user, since they help predict which film and batteries to recommend A ' 
grocery store may record the type of milk purchases, since a customer who regularly 
purchases whole milk may not value a recommendation for skim milk A bookstore 
may record a list of the books purchased by the customer to allow it to recommend 
sequels to books already purchased and to avoid recommending books that are ' 
incompatible with the ones already owned. 

The terms ^'elements", "sets" and "collections" are used in the 
description below. An element is typically a specific product that can be selected by the 
customer, whereas a set is generally a less specific grouping of elements. For example, 
a3Z<p.jatxj^H^U^^ oz;jar:.of"KraftTM mayonnaise" arc 

examples of elements, while "mayonnaise" describes a set of different elements that 
includes "Hellman's'^ mayotmaise" and "Kraft™ mayonnaise". A collection is a 
grouping of elements or sets of elements that may be associated with each other. For 
example, mayonnaise and dijon mustard may be placed in a collection because the 
marketer wishes to express the knowledge that a customer buying both mayonnaise and 
dijon mustard would be likely or unlikely to purchase "Dijonaise"™, which is a mixture 
of both mayonnaise and dijon mustard. The term **item" is used as a generic term to 
describe elements, sets and collections. 

Item compatibility rules 204 express compatibility relationships among 
items. There arc many ways of representing item compatibility: unidirectional 
implication rules, bidirectional implication rules, and generalized rules of various types, 
including multi-way rules. The rules themselves may relate individual items, sets of 
items, or specific collections, and they may ihclude weight factors or priorities to 
indicate the relative importance of or accuracy of the rule. The rules may also be 
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unweighted an unprioritized. Generally, the easiest niles to use are unweighted - - in* ; 
unidirectional rules that relate one item to another. Such rxiles are expressed in the jjb^^ic 
following manner: . ^-r.^^^- ^rtizcxnco^i' 

Complement rule: A->B A implies B 

v; . - Substitute rule: C -> --D C implies not D ; t . / riAol^rs^^ 
The basic complement rule means: when item A is recommended to, purchased by; or lo 
owned by a user, then item B is likely to be a good companion item. For example, if A : 
is "Diet Cereal" and B is "Skim Miik^* then the relationship A -> B indicates that people > 
who buy "Diet Cereal" are also likely to be interested in ''Skim Milk." . 

The basic substitute rule means: when item C is recommended to, 
purchased by, or owned by a user, then item D is unlikely to be a good companion item." 
For example, if C is "Manufacturer A's mayonnaise" and D is "Manu£au:turer B's * 
mayonnaise" then the relationship C -> -'D indicates that people are unlikely to buy l v: : 
mayonnaise from both Manufacturer A and Manxifacturer B. 

Bidirectional implication rules specify two-way relationships. For 
example, the bidirectional complement rule A <-> B indicates that A is a complement 
of B and B is a complement of A. This is a more general, and less powerful mechanism 
---than luudire since every rule X <— > Y can be transformed into two rules: 

X -> Y and Y -> X. However, there is no bidirectional way to represent that most 
"Diet Cereal" customers buy skim milk, but relatively few skim milk customers buy 
"Diet Cereal". Similarly, bidirectional substitute rules may be transformed into a pair of 
unidirectional rules with no loss of information. 

More generalized forms of expressing rules exist, including rules that 
have multiple implications. These rules may be used in the present invention, either 
directly by the compatibility modifier 200 or by transfomiing the rules into a form 
directly usable by the compatibility modifier 200. 

In addition to relating individual items, rules may also relate sets or 
collections of items. A mle relates a set of items when the left-hand-side (input), the 
right-hand-side (output), or both sides (input and output) contain an explicit or implied 
list of items, any one of which can be substituted into the rule. For example, in the rule: 
hot— dog-buns -> hot-dogs 
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hot-dog-buns and hot-dogs are both sets that represent all of the differenHridiVidual 
products in the category. The meaning of the rule is that the purchase^ -^^■"■'''^ 
(recommendation) of any item in the hot-dog-buns set would be complememed ljf a" 
recommendation of any product from the hot-dogs set. This type of tide can be 
transformed into a set of unidirectional rules among indiVidiikl iteins by' diUSg a rule 
for each pairing of an item from the left-hand-side (input) set with an item fibin'tiie^ ' 
right-hand-side (output) set TTie resulting number of rules is equal "to the pfiduct ijf " 
thenumber of items in each set , r; " lss-.- * . 

Similarly, substitute rules may be defined among sets of items. The rule: 
hot-dogs -> -4iot-dogs 
is a typical rule. It should be interpreted to read diat the purchase of any item in the 
hot-dogs set substitutes for (i.e., is incompaidble with) recommending any other item in 
the set In other words, dont recommend hot dogs to someone who already is buying or 
receiving a recommendation for other hot dogs. 

Item set substitute rules, as well as bi-directional item set compatibility 
rules can be transfonned mto item-to-item rules by pairing each item from the left- 
hand-side set with every item in the right-hand-side set, as suggested above. 

Item compatibility rules may intludc associated weights WviluM*^ 
guide the compatibility modifier 200. The specific weights and values used depend on 
the particular appUcation. One example involves assigning a rating-scale difference 
value to each lule. This value corresponds to die amount by which a recommendation 
should be changed when a rule applies. For example, if hot-dog-buns -> hot-dogs 
witii a weight of +2.0, then items m tiie set hot-dop gain 2 points on the 
recommendation scale when hot-dog-buns items are recommended or purchased. 

In a second example, a priority level is assigned to each rule, to allow 
rules of higher precedence to take priority over ones of lower precedence. For example, 
a "default" rule of lower priority might indicate tiiat different types of film are 
substitutes for one anotiier (fihn -> -rUm). Higher priority rules may indicate certain 
types of film as complementary with certain cameras (e.g., 35mm-camera -> 35mm- 
30 film and 1 10-camera -> 1 10 fihn). The differences in priority may help the 

compatibility modifier recognize tiiat a customer who owns two different types of 
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camera may want to buy two different types of film, even though most customers buy - - 
only one type. - riu u \ 

Item compatibility rules may be created in many different ways. These 
include, but arc not limited to, the following. An individual, such as a marketer^, may - - 
create the rules and enter them into the system using ari-input device 11 8: this may be ^ — 
termed a marketer specification. The rules may be generated automatically by a process'^ 
external to the present invention, including but not limited, to machine learning and : ' ^ 
statistical analysis processes such as genetic algorithms, neural networks, and rule : : j.- 
inference systems, data mining processes, and other statistical analyses of historical 
product preference and purchase data. The rules may be stored in computer memory 
1 04 or on a secondary storage device 1 08 and introduced into the system. Rules may ^ 
also be created by customers themselves, again entered through an input device 1 1 8: this 
may be termed a customer specification. In an embodiment described below, rules may ^ ^ 
be inferred within a reconmiendation engine itself. The rules used by the conq)atibility 
modifier 200 may be generated by more than one of these processes. 

The compatibility modifier 200 accepts as inputs the recommendation set 
201, the compatibility rules 204, and, optionally, the shopping set 202 and/or the history 
set 203, The compatibility modifier 200 appUes the compatibiUty rules^204dto the 
recommendation set 201, optionally using the shopping and historical sets 202 and 203, 
to produce a modified reconmiendation set . In this embodiment of the invention, the 
compatibility modifier 200 executes as a process on the computer system, for example 
computer system as shown in FIG. 1 , on one or more processors. The compatibility 
modifier 200 implements a modification algorithm, which is an algorithmic process that 
^plies the rules and generates the modified recommendation set 

An example ofa general flow chart to implement a compatibility ' 
modifier 200 is illustrated in FIG. 3. The recommendation set 201 is received at step 
30 1 . Next, it is determined whether a shopping set 202 exists or not, at step 302. If tiie 
shopping set 202 does exist, then it is received, at step 303. Next, it is determined 
whether a history set 203 exists or not, at step 304. If the history set 203 exists, then it 
is received by die compatibility modifier 200, at step 305. After all the input data sets 
201, 202 and 203 are received, the compatibility modifier 200 receives the item , - 
compatibility rules 204, at step 306. does the compatibility modifier fetch only the 
rules applicable to the items in the input data sets? The compatibility modifier 200 
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uses the rules 204 and the input data sets 202 and 203 to modify the recomirieWationset 
20U at step 307, and outputs compatibility-modified recommendations 205, at step'368. 

Several different modificadon algorithms may be used in the 
compatibility modifier 200, each of which accomplishes the goal of modifying a 
recommendation set by applying the compatibility rules to improve the value of set ' ' 
of recommendations collectiyely. Some of these algorithms also use information liboiff " 
items currently being considered by the user (i.e., the selection set) and items diai have^ " 
historically been preferred or purchased by the user (i.e., the historical set). - - 

One method for applying unweighted unidirectional rules to an ordered^'"'' 
recommendation set is shown in FIGs. 4A and 4B. A generalized form of the method ^ 
400 is illustrated in FIG. 4A, while a more specific form is illustrated in FIG. 4B. 'tlie ^ 
following description relates the specific steps shown in FIG. 4B to the general stq)s of 
FIG. 4A. In this method 400, a modified recommendation set 208 is produced using the 
following steps: 

1. If a shopping set 202 exists, as determined at step 452, all items that 
complement items in the shopping set 202 are added to a new, or empty, 
modified recommendation set. This is a general description of steps 403M08. 
1^^:^^ - :r,2. Allitems.in the original;recommendation set 201 are added, at step 454; to- 
the modified recommendation set. This is a generalization of step 409. 

3. All items that complement items in the historical set 203 (if any) and the 
original recommendation set 201 are added, at step 456, to the modified 
recommendation set. This step is a generalized description of steps 4 10-4 16 
and steps 4 17-422. 

4. All items that are substitutes for items in the shopping set 202 are removed^ 
at step 458, from the modified reconmiendation set. This is a generalized 
description of steps 423-429. 

5. Any items that are substitutes for earlier items in the modified 
recommendation set are removed at step 460, This is a generalized description 
of steps 430-438, 

In following the above steps, the recommendations presented to the user do not 
include a reconunendatipn not to buy an item present on the shopping list. 

Turning now to the specific embodiment illustrated in FIG. 48, it is 
important to note that all sets are assumed to be ordered sets without replication. The 
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UNION operator is assumed to preserve order. Various woricing sets, NewSet, OutSet, 
and SSet are initialized at step 401, and a determination is made, at step 402, whether a 
shopping set 202 exists. If there is no shopping set 202, then the method passes directly 
to step 409. If there is a shopping set, then the set SSet is tested to determine whether it . 
5 is empty. If it is empty, then the method passes to step 409. If SSet is not empty, then . 
the first item in SSet is selected out as Sitem and a temporary copy of rules Temp is 
initialized, in step 404. After Temp is tested for being empty, at step 405, the first rule 
in Temp is extracted as Rule, at step 406. If Rule is a complement rule and Sitem is an 
input to, in other words on the left hand side of, the Rule, as determined at step 407, 
10 then the item on the output of, i.e. on the right hand side of, the Rule is added to . 

NewSet, at step 408. Once all the rules have been tested, as determined at step 405, the 
method returns to step 403 for the next item in SSet. 

Once all the complements for the items in the shopping set have been 
identified and added to NewSet, NewSet is updated by the addition of the items in the 
1 5 recommendation set RecSet using the UNION operator, at step 409. 

A determination is made, at step 4 1 0, whether the history set HistorySet 
exists. If HistorySet does not exist, then the method proceeds to step 417. Where 
HistorySet is determined to exist, then a determination.is made. whether HistorySet is 
empty, at step 411. If HistorySet is empty, then the method proceeds to step 417. 
20 Where HistorySet is not empty, the first item in HistorySet is extracted as Hitem, and 
a temporary copy of rules Temp is initialized, in step 412. After Temp is tested for 
being empty, at step 413, the first rule in Temp is extracted as Rule, at step 414. If 
Rule is a complement rule and Hitem is on the left hand side of the Rule, as detemiined 
at step 415, then the item on the right hand side of Rule is added to NewSet, at step 
25 416. Once ail the rules have been tested, as determined at step 413, the method returns 
to step 41 1 for the next item in HistorySet. 

Once all the complements for the items in the history set have been 
identified and added to NewSet, the complements to the items in the recommendation 
set are added. This starts first by a determination of whether the recommendation set 
30 RecSet is empty, at step 417. If RecSet is empty, then the method proceeds to step 
423. Where RecSet is not empty, the fu^t item in RecSet is extracted as Ritem, and a 
temporary copy of rules Temp is initialized, in step 418. After Temp is tested for being 
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empty, at step 419, the first rule in Temp is extracted as Rule, at step 420. If Rule is a 
complement rule and Ritem is on the left hand side of the Rule, as determined at step 
421, then the item on the right hand side of Rule is added to NewSet, at step 422? %nce'' 
all the rules have been tested, as determined at step 41 9, the method returns to step'^ l 7 
for the next item in RSct — ..^ . ^ :rmvr:p zi 

Once no more items exist in RSet, as determined at step 4 1 7, fiewsit xs ^ 
tested to remove items that are substitutes for items in the shopping set This 
commences by dcterminmg, at step 424, whether the shopping set ShoppingSet is 
empty. If it is empty, them the method proceeds to step 430. If it is not empty, then the 
first item in ShoppingSet is extracted as Sitem, and a temporary copy of rules Temp is " 
initialized, in step 425. After Temp is tested for being empty, at step 426, the first fide ^ 
in Temp is extracted as Rule, at step 427. If Riile is a substitute rule and Sitem is on 
the left hand side of the Rule, as determined at step 428, then the item on the right hand 
side of Rule is subtracted from NewSet, at step 429. Once all the rules have been 
tested, as determined at step 426, the method returns to step 424 for the next item iii 
ShoppingSet. 

Once substitutes for all items in ShoppingSet have been removed from 
-NcwSet, the method proceeds to^teif 43 07^^^ a de^mihatibn is made of ^W&ther 
NewSet is empty. If NewSet is empty, then the method ends at step 439 by outputting 
OutSet If NewSet is not empty, then Nitem is extracted from NewSet, TRuIe is 
initialized as a temporary copy of RuleSet, and TRec is initialized as a temporary copy 
of Outset, at step 431. If TRule is empty, as determined at step 432, the method 
proceeds to step 438, If TRuIe is not empty, then the first rule in TRuIe is extracted as 
Rule, at step 433. A determination is made, at step 434, whether Rule is a substitute 
rule and Nitem is on the right hand side of Rule. If not, then the method returns to step 
432. If so, then a determination is made whether TRec is empty, at step 435, If TRec is 
empty, then the method returns to step 432. If TRec is not empty, then the first item in 
TRec is extracted as Rec, at step 436 and a determination made, at step 437, whether 
Rec is on the left hand side of Rule. If so, then the method returns to step 430, If not, 
then the method returns to step 435. 

Once TRuIe is determined to be empty, at step 432, OutSct is updated 
by adding Nitem, at step 438, after which the method returns to step 430. 
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This method 400 is useful for applications such as grocery shopping, 
where it is important to recommend item sets that are compatible with the items 
currently being purchased by the customer. This is ensured by making it a top priority 
to place complements to shopping set items at the top of the recommendation set and by 
removing any items that substitute for items in the shopping set. The second priority is n , 
to leverage the recommendations to create a better shopping set. The third priority;is to i 
take advantage of historical data. For a shopping ^plication, historical data might 
include information learned about the customer's pantry behaviors. For example, we 2 , 
may know that a particular customer tends to hvcy large quantities of pancake mix and 
therefore trigger a rule that may recommend pancake syrup. An interesting property of 
this algorithm is that it can function properly even when the recommendation set for a 
particular user is empty, if that user has a shopping or historical set In other words, if 
nothing is known about the customer, no reconunendations can be made based on die 
customer's tastes and historical purchases. However, items can still be suggested that 
that complement the custonier's current selections without substituting for any of those 
selections. 

Another method may be used that operates on a reconmiendation set in 
> which numerical recommendation scores are associated with the recommendations by 
applying a rule set that includes numerical difference values with the rules. This second 
method 500, shown in FIG. 5, constructs a modified recommendation set by applying 
the rules so as to modify the numerical scores for the recommended items and so as to 
add items when appropriate. The method 500 does not remove items from the 
reconmiendation set; instead it reduces the numerical recommendation score of less 
favored items. In actual use, the application may filter out recommendations with 
recommendation scores lower than a certain threshold, or may use low-scoring 
recommendations to create a "dis-recommended" list, that is a list of items to be 
avoided after item compatibility has been factored in. This method 500 uses an ' 
operation labeled "Apply a Rule" 5 1 0 which does the following: 

1. If the item on the right-hand-side of the rule is not in the modified 
recommendation set, that iteth is added to the modified recommendation set with 
a recommendation score that represents neutral preference (e.g., 3 on a scale of 1 
through 5). 
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2. For all items on the right-hand-side of a rule, either originally present in the 
modified recommendation or added in step 1, the rule's difference valuers acliied"' 
to (complement rules), or subtracted from (substitute rules) the reconimcridiiion * * 
score for that item on the right— hand-side. /.:c,^ -j.o:::^ a) 

5 Another way of performing step 2 is to add a modifierltolHe^recommend scbi«/ ^ "^'^^ 
where the modifier is positive for a complement rule and negative for a substitiite'rule. ' 

The remainder 520 of the method is used to create a modified - * 
recommendation set as follows: , v: 

1. Copy the original reconunendation set to initialize the modified ■ - 
10 recommendation set 

2. Step through each item in the shopping set and historical set, if any. If the 
item has not already been considered, then apply each rule that has that item on ^ - 
the left-hand-side. 

3. Sort the modified reconunendation set by numerical reconunendation score, 
1 S such that the first item has the highest score and the last item has the lowest 

score. 

4. Step through each item in the modified reconmiendation set If the selected 
item has a recommendation score below the recomffiMdatiocTthr^ 

For each item not skipped, select the set of rules that have the selected item on 
20 the left— hand-side. For each rule where the item on the right— hand— side has not 

already appeared earlier in the modified reconunendation set, apply the rule. 
After applying the rules that apply to the selected item, re-sort the remaining 
items in the modified recommendation set. 

5. Sort the entire modified recommendation set to produce a sorted output set 
25 This method 500 is advantageous in applications where every item has a 

reconunendation score or where items may intentionally have both high and low 
recommendation scores. By limiting the s^plication of rules to items being 
recommended favorably, or to items selected by the user, the method 500 algorithm 
avoids false reconunendations based on compatibility with imdesired items. The 
30 method 500 may be efficiently implemented using a known set representation, for 

example one that includes a hash table for rapid lookup and a heap for incremental - - ''^ 
sortii^. 
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A second embodiment of the invention is shown in FIG. e^In this 
embodiment, the compatibility modifier 61 1 is integrated into a recommendation engine „ 
600. The recommendation engine may be constructed using one of a number of f 
different methods, for example as is disclosed in Communications of the ACM r :i 
(Association for Computing Machinery) , voL 40(3), March 1997, in articles by :1 
Balabonovic et al., "Content-Based Collaborative Recommendation", pp. 66^72; Kautz 
et al., "Referral web: Combining social networks and collaborative fUtering", pp, 63- 
65; Konstan et al., "Grouplens: Applying collaborative filtering to Usenet News" pp. 
77-87; Resnick et al., "Recommender systems", pp. 56-58; Rucker et aL, "Sitcseen . 
Personalized navigation for the web" pp. 73-76; and Terveen et aL, "Phoaks: A systeih " 
for sharing recommendations", pp. 59-62, incorporated herein by reference. - . i 

A recommendation engine 600 has two roles and two inter&ces that ; ; :i 
match these roles: recording customer preferences 601 and making recommendations - I : 
6 1 0. This invention does not change the preference recording role, which is , 
accomplished through the recommendation engine's rating interface 604. The : 
reconunendation process includes compatibility as part of the recommendation criteria. 

A system using the modified recommendation engine has the following 
compon(yits:,. a,ratings input intcirface 604; a recommendation request inter&ce 605, 
which supports requests for recommendations for specific items or requests for a set of 
recommended items; an optional item match set input 602, which is used with a request 
for recommendations to specify a set of items with which the recommendation set 
should be compatible; an item compatibility rule set input 606; a recommendation 
process 608, storage 609 for customer ratings of items; and a recommendation output 
set 610, which is the output resulting from a recommendation request 603. 

The match set input 602 plays a role similar to that of the shopping set 
202 and historical set 203 described in the first embodiment The system 600 is referred 
to as a compatibility— aware recommendation engine. 

Implementations of a compatibility-aware recommendation engine 600 
may include any of the methods described above with regard to the first embodiment of 
FIGs. 2-5, vnth the shopping set 202 replaced by the match set 602 and the historical set 
not provided. An advantage of the present embodiment is that closer connections niay 
be made between the recommendation process and the compatibility information. 
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The compatibility process may be integrated into the recommendation in 
one of at least three ways: t:^, j -.wniv-oorns 

1 . Use of a match set and item compatibility rules to drive the rec^nunerida^on ^ ^ 
process. . • . -^.u^ 

5 2. Use of the recommendation engine to enhance item compatibility Wgon^flimsy'';^ ' '""^ 

3 . Integration of item compatibiliQr and recommendation processes in the ' ' ' ^ ' ' " 
reconmiendation engine. : - , v.ii^ 

- - One particular method that uses the match set and item compaidbility 

rules to drive the recommendation process is shown in FIGs. 7A and 7B. The method ' ^ 
10 750 illustrated in FIG. 7A is a generalized method, whereas the method 700 in FIG. 78 ^ '' 
is one particular implementation of the generalized method 750. The following ^^ ' ' ' '^^^^ 
description relates the specific steps shown in FIG. 7B to the general steps of FIG. 7A. 
In this method 750, a compatibility— aware recommendation set 610 is produced lising 
the following steps: 

15 1 . A set of items compatible with those in the match set is generated, at step ' ^- ; ' 
752. Ilie set of compatible items includes those that complement items in the 
match set but do not substitute for items in the match set. This is a generalized 
■■- '.description of steps 703^-709- ■^-"-'■--^^ ' ■'■ --^ 

2. Recommendation scores are obtained for each item in the set, step 754. This 
20 is a generalized description of steps 711-713. 

3. A subset of those items is selected such that no item and its substitute are in 
the set and such that more highly recommended items outweigh items with 
lower recommended scores, at step 756. This is a generalized description of 
steps 714^723. 

25 Turning now to the specific embodiment illustrated in FIG. 7B, it is 

important to note that all sets are assumed to be ordered sets without replication. The 
UNION operator is assumed to preserve order. Various working sets, RecSet, and 
OutSet are initialized at step 701 , and a determination is made, at step 702, whether the 
match set 602, MatchSet, exists. If there is no match set 602, then the method passes 

30 directly to step 710. If there is a match set 602, then the set MatchSet is tested to 

determine whether it is empty, at step 703. If it is empty, then the method passes to step 
709. If MatchSet is not empty, then the first item in MatchSet is selected out as 
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Mitem and a temporary copy of rules Temp is initialized* in step 704. After Temp is 
tested for being empty, at step 70S« the first rule in Temp is extracted as Rule, at step 
706. If Rule is a complement rule and Mitem is on the left hand side of the Rule, as 
determined at step 707, then the item on the right hand side of Rule is added to' RecSet, 
S at step 708. Once all the mles have been tested, as determined at step 70S, the method 
returns to step 703,for the next item in MatchSet ^ ' vv;: ^:^ ' 

Once it has been determined, at step 703, that no items remain in 
MatchSet, a determination is made whether RecSet is empty. If it is empty, then the ^ 
method proceeds to step 710, where OutSet is set equal to RecommendedNItems, at ^ ^ 
10 step 710 and output at step 724. 

If RecSet is not empty, then a loop, steps 7 II -7 13, is set up to produce a 
recommendation score for each item in RecSet Once all items have recommendation 
scores, the items in RecSet are sorted in descending order according to recommendation 
score, at step 714. 

1 S The first item in RecSet is extracted as Ritem, a temporary copy of the 

rules is initialized as TRule, and a temporary copy of OutSet is set up as TRec, at step 
716. A determination is made, at step 717, as to whether TRule is empty. If so, then 
Ritem is added to OutSet via the UNION operatbryat step 723. If not; then the first 
rule in TRule is extracted as Rule, at step 718. A determination is meuie, at step 719, 

20 whether Rule is a substitute rule and Ritem is on the right hand side. If not, then the 
method returns to step 717- If so, then a determination is made whether TRec is empty, 
at step 720. If so, then the method returns to step 717, If not, the first item in TRec is 
extracted as Rec, at step 721, and a determination made, at step 722, whether Rec is on 
the left hand side of Rule. If Rec is not on the left hand side of Rule, then the method 

25 returns to step 720. On the other hand, if Rec is on the left hand side of Rule, then the 
method proceeds to step 715. 

A method 800 that bears some similarity to the method 500 illustrated in 
FIG. 5 takes advantage of a recommendation engine's prediction abilities, and is in FIG. 
8. In this method 800, the "Apply a Rule" step 810 generates a reconunendation value 

30 within the recommendation engine, rather than starting new items in the list with a 
neutral default reconunendation value. This illustrates an advantage of this second 
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embodiment, vir. the ability to transition seamlessly between the recommendation --'i^;^ 
process and the item compatibility process. ^ cabrJ -.iff bat^i-? 

FIG. 9 shows a data structure 900 and methods 901, 902 fonrifMring SOv 
item compatibiiity rules in a recommendation engine. The data structure 900 is the'^^alJ 

5„i. upper righttriangle of a two-dimensional array that maps items to items: In eailhceirbf ' 
the array is stored the number of times that each pair of items was piirchMeS tog^therf 
either as part of a single transaction or as part of a longer-term customer relationship. 
This data is augmented by a simple array 903 that stores the total number o^' .s-^^ii^^^' 
transactions, N„, (or relationships) in which each item, aa, ab. za^ vras' f * 

) purchased. ' tpia 

The substitute rule inference method 901 finds pairs of items such that, 
one item is generaUy not purchased when the other is purchased. It has two operating I . 
tiiresholds, one for the maximum co-purchase percentage and another for tiie number of - . 
purchases needed to judge accurately. The maximum percentage (SubThreshold) 
identifies when items are likely not to be substitutes. The number of purchases 
(SubSignifThreshoId) is an estimate of confidence. For example, we may decide that^ 
, groceries require a maximum co-purchase percentage of 1% and a miniiftuni of 10.000 
purchases to judge accurately. If, for example, we are testing skim milk against whole 
milk, and skim milk was purchased 20,000 times, whole milk was purchased 15,000 
times, and Uiey were purchased together 1 75 times, we would conclude as follows: 

1 . When people buy skim milk, tiiey generally don't buy whole milk 
(175/20,000 < 0.01) and with 20,000 examples of buying skim milk, we 
confidentiy infer the rule "skim milk -> NOT whole milk". 

2. When people buy whole milk, they buy skim milk often enough to prevent a 
rule (175/1 5,000 > 0.01). 

The complement rule inference method 902 finds pairs of items such that 
one item is generally purchased when the other is purchased. It has two operating 
thresholds, one for the minimum co-purchase percentage and another for tiie number of 
purchases needed to judge accurately. The minimum percentage (Compthreshold) 
identifies when items are likely not to be complements. The number of purchases 
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(CompSignifThreshoId) is an estimate of confidence. For example, we may decide ■'- 
that groceries require a minimum co-purchase percentage of 50% and a minimum of ' 
10.000 purchases to judge accurately. If. for example, we are looking at the correlation 
between purchases of breakfest cereal and milk, and milk was purchased 20.000 times, 
while cereal was purchased 15.000 times, and they were purchased together 8,000 
times, we would conclude as follows: 

1 . When people buy cereal , they generally buy milk (8,000/15.000 > 0.5) and 

with 15.000 examples of buying milk, we confidenUy infer the rule 
"cereal -> milk". 

2. When people buy milk, they also buy cereal sufficiently infrequently that we 
are prevented from infening a rule (8,000/20,000 > 0.5). 

Alternative implementations of these algorithms can use basic statistical - 
methods to vary the number of items needed for confidence. In this case, the parameter 
used is the desired probability of correctness. Also, while the example uses language of 
purchases, the algorithms and data structures can leam from non-purchase behavioral 
data including but not limited to reading items, evaluating items, and rating items. 

The present invention is not restricted to operating on a single processor ■ 
system. In the embodiments of the invention described herein, each process may reside 

wholly within a single processor or be distributed among multiple processors. For 
example, the recommendation engine 608 may itself be resident on a single processor or 
distributed among several processors either for economic advantage, to achieve 
redundancy and higher availability, to achieve better performance, for geographic 
diversity, or for other reasons. Furthermore, each separate process may operate on the 
same proccssor(s), different processor(s), or an overlapping but different set of 

processors from each other process. For example, with regard to the embodiment 
illustrated in HG. 2. an item compatibility rule input may be on a different processor 

from a compatibility modifier, but on the same processor as the historical set input, 
while the shopping set input may be split between the processor of the compatibUity 
modifier and a third processor. In the case where more than one processor is used in the 
system, the processors are construcUvely, or opcratively, coupled. Methods of such 
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constructive coupling include, but are not limited to. connection through the intern^ bus 
of a multiprocessor computer, connection through shared computer memory of storage 
devices, connection on a local area network, connection on a wide area network] " 
connection through as-needed communications such as modems and telephone lines, or 
5 cbiihection through periodic data interchange such as'fransferring data on disks or tapes. 

The present invention is useful in many different applications. For " 
convenience, we refer to the output obtained from the two embodiments described 
above as "compatibility modified recommendations," to the first embodiment 200 as a 
"compatibility modifier for reconunendations," and to the second embodiment 600 as a 
10 "compatibility aware recommendation engine." The use of the term "compatibility 
modified recommendations" is not intended to imply interest only in the ou^ut 
reconunendation set, but rather to refer to the entire method that generates such output 
reconunendation sets. 

One way of developing an application that uses compatibility modified 
1 5 recommendations, a system designer or administrator identifies and coimects the source 
of rules, determines whether the system will use shopping, historical, or match sets', and 
" ^ "configiires the reconuheiidationr system as it woiild be used without compatibility 

modification. The designer or administrator then substitutes the compatibility aware 
recommendation engine for an ordinary recommendation engine or adds a compatibility 
20 modifier for recommendations between the recommendation generation and its display 
to a user. Figure 10 shows one embodiment of how these modifications may be made 
to an existing system. System 1080 is a non-compatibility-aware call center system 
having a call center agent console 105 1 connected, via a network 1052, to a call center 
application server 1053. The application server 1053 is further connected to one or 
25 more memory units containing customer information 1 054 and product information 
1055, The application server 1053 is also cormected to receive a list of items 1056 
recommended for marketing to customers. The list may be generated using any of the 
techniques listed above. 

System 1090 is a call center system that includes compatibility filtering. 
30 Instead of receiving the list of recommendations 1056 directly, the application server 
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1053 receives compatibility filtered and weighted recommendations 1064 from a 
compatibility filter 1061. The compatibility filter receives 1061 the list of ^ 
recommendations 1 056 and, using compatibility rules 1 063. current purchase ' 
information 1061 from the application server 1053, and customer history informatidfr ' = 
5 1 062 from the customer information 1054. filters and weights the recominendatioris to 
produce the set of compatibility filtered and weighted recommendations 1064. ^•c-5;.!ooH 
While each application has diflFerent requirements, we present two ' ^ 'i- ' 

sample applications and also identify a larger number of applications of the invention. - 
This set of examples is not intended to limit the applicability of the invention. • "'l 
^® tbe present invention may be extremely useful m electronic : > ■-■ 

commerce appUcations on the Internet. FIG. 1 1 shows an iUustration of a conqjatibility- 
aware recommendation engine 1 1 10 in an electronic commerce application. The 
customer 1 102 uses a web browser, for example on a personal computer 1 101 to 
connect tiu-ough a network 1 101 to a web server 1 104. The commeree server 1 106, 
1 5 connected to tbs web server 1 1 04. processes aU financial transactions for the customer 
1 1 02 and contains a database of products for sale. The web server 1 1 04 presents tiiis set 
of products for sale to the customer 1 102. A purchase database 1 108,-cbi^red to tiie v 
commerce server 1 106, contains records of previous purchases made by the customer 
1 102 and other customers. 

A compatibility-aware recommendation engine 1 1 0 1 is coupled to the 
web server 1 104, the commerce server 1 106, and the purchase database 1 108. The 
recommendation engine 1 1 0 1 may purchase data, e.g. implicit ratings, fi-om the 
purchase database 1 1 08 and may also receive ejqilicit ratings fi:om tiie customer 1110 
via tiie web server 1 1 04. The recommendation engine 1 106 also receives match set 
25 information fixjm tiie commerce server 1 106, i.e. tiie current state of tiie market basket 
and any otfier relevant customer historical items. The recommendation engine 1110 
receives requests bom the web server 1 1 04 and/or the commerce server 1 1 06 for 
recommendations. These requests may focus on specific products or may be mote 
general. The recommendation engine 1110 generates recommendations, using 
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compatibility infomation, to ensure that the recommendations supplied are iohe^m." 
and useful as a set and consistent with the user's current purchases. v:! >^ - ' ' 

There are many content domains within electronic conmiCTce M^CT^^^ 
compatibUity aware recommendation engine, or compatibility modified "f"" " 

=^recommendations itf general, wouia'be useful. A specific example is ah on-iine "^^ ' 
bookstore. In this application, the commerce server contains a database of all bo^k^' 
available for sale, indexed at least by ISBN, title, author, and subject. The commerce 
server also maintains a "shopping basket" of books that tfie user is currenUy pl^niiig to 
buy and a set of "recently purchased" books that the user has purchased within certoin 
period of time, for example the past six months. The web server presents the user with 
various options for browsing books including viewing by topic, searching for bboics 
based on author, tide, or ISBN, browsing best seUers. or simply asking for 
recommendations. Whenever a specific book or small set of books is sought, the web 

server can request reconmiendation scores fix>m the compatibility aware 
recommendation engine for recommended books and present the recommendations to 
the user. These recommendation scores may be compatibility modified to help the user 
and the systeitt identify books that match v^^ othfer purchases. When die user 
requests recommendations or a large set of books such as "fiction," die web server may 
ask the compatibility-aware recommendation engine for recommendations overall or 
widiin a category. The recommendation engine can dien evaluate die books bodi on 
dieir own merits for die user, and as part of a set of books, and recommend a coherent 
set of books that is compatible with die odier books selected by die user. 

Another use of the recommendation engine is for the web server to 
request recommendations for books to advertise as part of the check-out process. The 
invention is advantageous because it prevents die system from recommending 
substitutes for current purchases and suggests books diat complement die purchases. 

A second illustrative application for such a system is to provide support 
for human sales staff in suggestive selling. In diis application, depicted in FIG. 12, a 
sales agent 1214 uses an interface 1206 to a raiill center "console 1204. The interlace" 
1206 is used by die agent 1214 to enter product requests firom die customer 1202. The 
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call-center console 1204 is coupled to a commerce server 1208 that contkiiik' ' ' ''' ' ' 
informaUon regarding products on offer to the customer 1202. typically including 
pricing and availability. A purchase database 1210 is connected to the commerce sel^^^ 
1208 to record transactions with the customer 1202 and other customers. A ' ' "'' ' 
recommendation engine 1212. either a recommendation engine having compatiliifi^ 
awareness integrated with the recommender. or having a compatibility modifier to^^ ' ' ' 
modify recommendations, is coupled to the commerce server 1208 and the purchase 
database 1210. . GompatibUity-aware or compatibility-modified recommendations ai^ ' 
generated by the recommender system 1212. and are updated to reflect each customer ' 
product request the recommendations are displayed to the sales agent 1214 to help""" " . 
suggest other products for cross-selling. Depending on the business objectives of the ' 
marketer, the recommendations may be limited to a set of products that are featured, 
may span the uiventory of the business, or may be restricted to products with specific 
attributes, for example products that are in-stock or have a high mark-up. 

Another example is illustrated in FIG. 13 that shows a cash-register 
check-out system. A cash register 1302 is connected to via a recommender system 1306 
to a purchase database 1308. The recommender system 1306 suggests additional 
purchases to the customer while purchases are entered into the cash register 1302. An 
additional feature of the cash register check-out system is the ability to print a coupon 
compatible with current purchases using a coupon printer 1304; this coupon may induce 
the customer to return to make more purchases sooner than the customer would have 
returned without the coupon. 

Many other content areas can similarly be enhanced by compatibility 
modified recommendations. Examples include music in various forms (e.g., sheet 

music, music recordings, music video recordings, and on-demand music systems 
including jukeboxes and cable-TV music request services), advertisements, marketing 
literature and product offers, consumable goods including groceries and oflBce supplies. 

dining and entertainment services (c.g.. arranging a set of dinner and/or tiieater 
reservations that complement each other), financial service products (e.g.. 
recommending financial service products compatible witii the customer's goals and 
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portfolio), teal estate and home furnishings, automobile-related goods and services, - - 
travel-related goods and services, media of various forms (e.g., audio, video, images),^ " * 
computer products and services, art works, publications and documents. In each of ^ 1 
these areas, and many others, the benefit of compatibility modified recommendations is 
5 the added value to the customer and to the niarketer when product recommendadons are ' 
consistent with prior purchases, concurrent purchases, and each other. ? * ■ ^ 

Another embodiment of the invention, illustrated in FtG. 1 4 A, includes a 
processor system 1400 configured to receive applicable data including i)~item 
recommendations 1406. ii)a shopping set 1408 and iii) a history set 1410. The 

10 processing system is configured to produce a set of item compatibility rules 1404. The 
processing system 1400 is also configured to produce a compatibility-modified 
reconunendation set 1412 using at least the item recommendations 1405 and the item . 
compatibility rules 1404. The processor system 1400 may be a single processor for 
producing the compatibility rules and performing the compatibility modification. 

15 The processing system may also include a number of different 

processors. Another embodiment of a the processing system is illustrated in FIG. 14B, 
where the processing system includes^a first processor 1420 (shown in dashed lines) 
configxired to receive the recommendation set 1406, the shopping set 1408 and the 
history set 1410, and to modify the reconunendations to become compatibility aware. A 

20 second processor 1422 (also in dashed lines) is operatively coupled to the first processor 
1420 and is configured to produce the item compatibility rules 1404 and to direct the 
item compatibility rules to the first processor 1420. The second processor 1422 may be 
remote from the first processor 1420 and coupled to the first processor 1420 through a 
network , the Internet, or some other communications channel. 

25 It will be appreciated that the compatibility-aware recommender system 

illustrated in FIG. 6 may be situated on processing system having a single processor, or 
a number of processors. For example, the recommendation process 608 may be on a 
first set of processors, including a single processor, while all other items, including the 
item compatibility rules 606, match set 602, rating storage 609, and otfier items, are all 

30 located on a second set of processors, including a single processor. In another example. 
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the recommendation process 608 may be on a first set of processors, while all the oth^ 
Items, including the item compatibility rules 606, the match set 602, and the rating 
storage 609, are each located on, or associated with, their own separate, individual set of 
processors. It should be^appreci^ed that where the lerm "set of processors** is used,' the 
5:. set inay.include only a single processor r >r . .>/ . . . j^^q^:. 

As noted above, the present invention is applicable to recommender^*- - - 
systems. It is believed to be particularly useful in permitting reconunender systems to 
produce recommendations that are not only accurate but also of high yalue to the user, 
i.e. recommendations are compatible with other purchases or recommendations. . 
10 Accordingly, the present invention should not be considered limited to the particular 
examples descnibed above, but rather should be understood to cover all aspects of the 
invention as fairly set out in the attached claims. Various modifications, equivalent 
processes, as well as numerous structures to which the present invention may be 
applicable will be readily apparent to those of skill in the art to which the present 
15 invention is directed upon review of the present specification. The claims are intended 
to cover such modifications and devices. 
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WE CLAIM ; ■ - : 'v 

1 . An electronic processing system for generating a compatibility-modified 
recommendation output set to a user based, at least in part, on a^sct of item ' ■ 
compatibility rules, the system comprising a processing systerh of one or more sets of 
processors configured to: . ' - > / 

a, receive applicable data including ^ : ? : . 

i. item reconunendation data, and ^ - " ' 

iu -item compatibility rules, and ^: . 

b. modify the item recommendation data using the item ^ ^ 
compatibility rules to produce a compatibility-modified recommendation qu^ut 
set. * , - : - 

2. A system as recited in claim 1 , wherein the processmg system is fiirther 
configured to - 3 ' ■ : 

a. receive shopping data, 

b. apply the . item compatibility rules to the^^^^^ 

c. modify the item recommendation data using the item 
compatibility rules applied to the shopping data to produce the compatibility- 
modified recommendation output set 

3. A system as recited in claim 2, wherein shopping data received by the 
processing system is derived from one of: a customer action of selecting an item for 
purchase; contents of an electronic "market basket"; active shopping carts; cash register 
transactions; a customer's shopping list; and observation of customer behavior. 

4. A system as recited in claim 1, wherein the processing system is further 
configured to 

a. receive historical data, 

b. apply the item compatibility rules to the historical data, and 
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c. modify the item recommendation data using the item 
compatibility rules applied to the historical data to produce the compatibility- 
modified recommendation output set 



5. A system as recited in claim 4, wherein the historical data is received as 
one of: prior purchases; recent purchases; expressed or infeired user preferences: data 
gathered from credit card records; and data gathered from marketing surveys. 

6. A system as recited in claim 1 , wherein the processing system is 
configured to receive the item recommendation data from at least one of: an outside 
source; a genetic algorithm; a collaborative filter, a neural network; a statistical model; a 
vendor specification; a human expert; and a computer-based expert. 

7. A system as recited in claim 1, wherein the processing system receives 
the item recommendation organized as one of: an unordered set; an ordered set without 
recommendation values; and an ordered set with recoomiendation values. 

8. A system as recited in claim 1, wherein the processing system is fiirther 
configured to derive the item compatibility rules from one or more of: 

a. a marketer specification, 

b. automatic generation using machine learning, 

c. automatic generation using a genetic algorithm, 

d. automatic generation using a neural network, 

e. automatic generation using a rule inference system, 

f. data mining, 

g. an analysis of historical purchase and preference data, and 

h. a customer specification. 

9. A system as recited in claim 1 , wherein the processing system is fiirther 
configured to receive the item compatibility rules represented as at least one of: 

a. unidirectional rules, ' 
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b. bidirectional rules, 

c. generalized rules inclucling multi-way'rules, ' ■ / ' ^ 

d. rules among items, ' - . . . k 

e. rules among sets, 

f. rules among collectiomV 

g. rules with weight factors^ 

h. rules with priorities, and 

i. unweighted and unprioritized rules. . 

1 0. A system as recited in claim 1 , wherein the processing system is further 



configured to: 



a. determine whether a shopping set exists, 

b. receive the shopping set when the shopping set is determined to 



exist. 



c. detennine whether a history set exists, 

d. receive the history set when the history set is determined to exist, 

e. receive the item compatibilily rules, and 

g. modify the recommendation set based on the received item 
compatibility rules and the shopping set and the history set when the 
shopping set and the history set are determined to exist 

11. A system as recited in claim 1 , \^erein the processing system is further 
configured to: 

a. add items in the item reconunendation data to the compatibility- 
modified recommendation output set, 

b. add, to the compatibility-modified recommendation output set, 
items that complement items in the item recommendation data, and 

c. remove, from the compatibility-modified recommendation output 
set, substitute items that are substitutes for items placed in the modified 
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recommendation set before the substitute items were placed in the modified 
recommendation set , . , . 

12. A system as recited in claim 1 1. wherein the processing system is further 
configured to: 

a, determine whether a shopping set exists, 

b, initialize the compatibility-modified recommendation set with 
items that complement items in the shopping list when the shopping set is 
determined to exist, and 

c, remove, from the compatibility-modified recommendation ou^ut 
set, items that are substitutes for items in the shopping set 

13. A system as recited in claim 11, wherein the processing system is further 
configured to: 

a. determine whether an historical set exists, and 

b. add, to the compadbility-modified recommendation output set, 
items that complement items in the historical set when the historical set is 
determined to exist 

14. A system as recited in claim 1. wherein the item recommendation data 
includes recommendation values, and the processing system is fiirther configm^ to: 

a, initialize the compatibility-modified recommendation set with the 
item recommendation data, 

b- determine whether a shopping set exists and whether an historical 

set exists, 

c. for each particular item in the shopping set, when the shopping 
set is determined to exist, apply rules having the particular item in the shopping 
set on the rules' inputs, and add items to the compatibility-modified 
reconunendation set and subtract items from the compatibility-modified 
recommendation set when the applied rules so determine. 
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d- for each particular item in the historical set, when the 
set is determined to exist, apply rules having the particular item in the historical 
set on the rules* inputs, when the particular item in the historical set is not also 
in the shopping set, and add items to the compatibility-modified 
recommendation set and subtract items from the compatibility-modified 
recommendation set when the applied rules so determine, 

e. sort items in the compatibility-modified recommendation ou^ut 
set according to recommendation value, 

£ for each examined item whose recommendation score exceeds a 
reconunendation value, select a first sub-set of rules v^diose inputs include the 
examined item, 

g. select a second sub-set of rules Srom the first sub-set of rules 
where rules in the second sub-set have outputs with items not appearing above 
the examined item in the compatibility-modified output set, 

h. apply the rules in the second sub-set, 

i. sort items in the compatibility-modified reconunendation output 
set below the examined item according to recommendation score, and 

j. sort all items in the compatibility-modified reconunendation 
output set according to recommendation score. 

15. A system as recited in claim 14, wherein applying a rule to a selected 
item includes 

examining a rule having the selected item on an input, 

adding an item on an output of the rule to the compatibility-modified 

recommendation output set where the item on the output is not cdready in the 

compatibility-modified reconmiendation output set, and applying a neutral 

recommendation score to the added item, and 

adding a recommendation score modifier to a recommendation score for 

all items on the output of the rule. 
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16. A system as claimed in claim I, further configured to: 

a. determine that a first and a second item have each been selected a 
number of times that is greater than a selection threshold ' ^ - ^ . 

b. determine the number of times the first item has been selected by 
the user when the user has selected the second item, . . ^ ■ 

c. compare, for one of the first and second itenis, the number of 
times that tfie one of the first and second items has been selected at the same 
time as the other of the first and second items, with the total number of times the 
one of the first and second items has been selected to produce a coincidence 
indicator, and 

A infer a substitute rule between the two items when the v l ^ 
coincidence indicator indicates coincident selection of the first and second items 
at a level below a substitute threshold level. , . 

17. A system as claimed in claim 1 , further configxired to: 

a determine that a first and a second item have each been selected a 
number of times that is greater than a selection threshold, 

b. detemiine the number of times the first item has been selected by 
the user when the user has selected the second item, 

c. compare, for one of the first and second items, the number of 
times that the one of the first and second items has been selected at the same 
time as the other of the first and second items, with the total nimiber of times the 
one of the first and second items has been selected to produce a coincidence 
indicator, and 

d. infer a complementary rule between the two items when the 
coincidence indicator indicates coincident selection of the first and second items 
at a level above a coincidence threshold level. 
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18. A system as recited in claim 1. wherein the processing system comprises 
a first set of processors connected to a computer network, the set of first processors 
being configured to 

a. receive the applicable data including 

5- i, the item recommendation data, an<l 

ii. the item compatibility rules, and 

b. modify the item recommendation data using the item * ' 

- compatibility rules to produce the compatibility-modified recommendation 
output set 



19. A system as recited in claim 1 8, wherein the processing system further 
includes a second set of processors cormected to the computer network, the second set 
of processors being configured to derive the item compatibility rules. 

20. A system as recited in claim 1 8, wherein the first set of processors is 
configured to derive the item compatibility rules. 

21. A method of producing a compatibility filtered and weighted 
recommendation to a user, the method using a computer having a processing system 
having one or more sets of processors, and an input/output interface, the method 
comprising: 

a. receiving, by the processing system, applicable data including 

i. item recommendation data, and 

ii. item compatibility rules, and 

b. modifying the item recommendation data, with the processing 
system, using the item compatibility rules to produce a compatibility-modified 
recommendation ou^ut set 

22. A method as recited in claim 2 1 , further comprising 

a. receiving shopping data, using the processor system, from the 
input/output interface. 
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b. applying the item compatibility rules to the shopping data iisijig 
the processor system, and , ; / ,- fT:fno:>'- 

c. modifying the item recommendaUon data, with the processing 
system, using the item compatibility rules applied to the shopping data to 
produce the compatibilify-modifieid recommendation output set- ^ ' " 



23. A method as recited in claim 22, farther comprising receiving shopping 
data, using the processor system, derived from one of: a customer action of selecting an 
item for purchase; contents of an electronic "market basket"; acti ve shopping carts; cash 
register transactions; a customer's shopping list; and observation of customer behavior. 

24. A method as recited in claim 21, farther comprising 

a. receiving historical data using the processor system. 

b. applying the item compatibility rules to the historical data using 
the processor system, and 

c. modifying the item recommoidation data, with the processor 
system, using the item compatibiKty ndes appUed to the historicaJhdata to 
produce the compatibility-modified recommendation ou^ut set 

25. A metiiod as recited in claim 24, farther comprising receiving the 
historical data, using the processor system, as one of: prior purchases; recent purchases; 
expressed or inferred user preferences; data gathered from credit card records; and data 
gathered from marketing surveys. 

26. A metiiod as recited in claim 2 1 , farther comprising receiving item 
recommendation data, using tiie processor system, from at least one of an outside 
source, a genetic algoritiun, a collaborative filter, a neural network, a statistical model, a 
vendor specification, a human expert, and a computeiH)ased expert. 

27. A method as recited in claim 2 1 , fijrther comprising receiving die item 
recommendation data, using tixe processor system, organized as one of an unordered set. 
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an ordered set without recommendation values, and an ordered set with 
recommendation values. v . loi'^^?';:;:^ > . 

28. A method as recited in claim 21, further comprising deriving the item 
compatibility rules, using the processor system, firom one or more of: . 

a. a marketer specification^ 

b. automatic generation using machine learning, p .\ 

c. automatic generation using a genetic algorithm, . . 

d. automatic generation using a neural network, , ..v. 

e. automatic generation.using a rule inference system, . . , 
f data mining, 

g. an analysis of historical purchase and preference data, and 

h. a customer specification. 

29. A method as recited in claim 2 1 , further comprising receiving, using the 
processor system, the item compatibility rules represented as at least one of: 

a, unidirectional rules, 

rj. : - ^- bidirectional rules,, 

c. generalized rules including multi- way rules, 

d. rules among items, 

e. rules among sets, 

f rules among collections, 

g. rules with weight factors, 

h. rules with priorities, and 

i. imweighted and unprioritized rules. 

30. A method as recited in claim 21, further comprising 

a. determining, using the processor system, whether a shopping set 

exists, 

b. receiving, using the processor system, the shopping set when the 
shopping set is deteraiined to exist. 
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c. determining, using the processor system, whether a history set 

exists, 

d. receiving, using the processor system, the history set when the 
history set is determined to exist, 

e. receiving, using the processor system, the item compatibility 
rules, and . ^ . 

g. modifying, using the processor system, the recorxunendation set 
based on the received item compatibility rules and the shopping set and the 
history set when the shopping set and the history set are determined to exist 

31. A method as recited in claim 2 1 , further comprising: 

a. adding items in the item recommendation data, using the 
processor system, to the compatibility-modified recommendation ou^ut set, 

b. adding, to the compatibility-modified recommendation output set, 
items that complement items in the item recommendation data, using the 
processor system, and 

c. removing, firom the compatibility-modified recorxunendation 
output set, substitute items that are substitutes for items placed in the modified 
recorxunendation set before the substitute items were placed in the modified 
recommendation set, using the processor system. 

32. A method as recited in claim 3 1 , further comprising 

a. determining, using the processor system, whether a shopping set 

exists, 

b. initializing the compatibility-modified recommendation set with 
items that complement items in the shopping list when the shopping set is 
determined to exist, using the processor system, and 

c. removing, from the compatibility-modified recommendation 
output set, items that are substitutes for items in the shopping set, using the 
processor system. 
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33. A method as recited in claim 3 1 , further comprising 

a. determining, using the processor system, whether an historical set 
exists, and 

b. adding, to the compatibility-modified reconuncndation output set, 
items that complement items in the historical set when the iSstorical set is - - 
determined to exist, using the processor system. 

34. A method as recited.in claim 21, wherein the item recommendation data 
includes recommendation values, and further comprising 

a. initializing, using the processor system, the compatibility- 
modified recommendation set with the item reconuncndation data, ' " 

b. determining whether a shopping set exists and whether an 
historical set exists, using the processor system, 

c. for each particular item in the shoppmg set, when the shopping 
set is determined to exist, applying rules having the particular item in the 
shopping set on the rules* inputs, and adding items to the compatibility-modified 
reconuncndation set and subtracting items from the compatibility-modified 
recommendation set when the applied rules so determine, using the processor 
system, 

d. for each particular item in the historical set, when the historical 
set is determined to exist, applying rules having the particular item in the 
historical set on the rules' inputs, when the particular item in the historical set is 
not also in the shopping set, and addmg items to the compatibility-modified 
recommendation set and subtracting items from the compatibility-modified 
recommendation set v^en the applied rules so determine, tising the processor 
system, 

e. sorting items in the compatibility-modified reconuncndation 
output set according to recommendation value, using the processor system, 
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£ for each examined item whose recommendation score exceeds a 
recommendation value, selecting a first sub-set of rules whose inputs include the 
examined item, using the processor system, 

g. selecting, using the processor system, a second sub-set of rules 
fit)m the first sub-set of rules where riiles in the second sub-set have outputs 
with items not appearing above the examined item in the compatibility-modified 
ou^utset, , 

h. applying the rules in the second sub-set, using the processor 

system, 

i. sorting items in the compatibility-modified recommendation 
output set below the examined item according to recommendation score, using 
the processor system, and 

j. sorting all items in the compatibility-modified recommendation 
output set according to recommendation score, using the processor system. 

35. A method as recited in claim 34, wherein applying a rule to a selected 
item includes 

examining a rule having the selected item on an input, iising the 
processor system, 

adding, using the processor system, an item on an output of the rule to 
the compatibility-modified recommendation output set where the item on the output 
is not already in the compatibility-modified recommendation output set, and 
applying, using the processor system, a neutral recommendation score to the added 
item, and 

adding, using the processor system, a recorxunendation score modifier to 
a recommendation score for all items on the output of the rule. 

36. A method as claimed in claim 2 1 , ftirther comprising 
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a. detennining, using the processor system, that a first and a second 
item have each been selected a number of times that is greater than a selection 
threshold, V. . a-^..:a^ 

b. determining, using the processor system, the number of times the 
" first item has been selected by the user when the user has selected the second 

Item, ■ 

c. comparing, for one of the first and second items, liie nuinber of 
times that the one of the first and second items has been selected at the same 
time as the other of the first and second items, with the total nimiber of times the 
one of the first and second items has been selected to produce a coincidence 
indicator, using the processor system, and ^ ;^ 

d. inferring, using the processor system, a substitute rule between 
the two items when the coincidence indicator indicates coincident selection of 
the first and second items at a level below a substitute threshold level. 

37, A method as claimed in claim 21, further comprising 

a- determining, using the processor system, that a first and a second! 
item have each been selected a number of times that is greater than a selection 
threshold, 

b. detennining, using the processor system, the number of times the 
first item has been selected by the user when the user has selected the second 
item, 

c. comparing, for one of the first and second items, the number of 
times that the one of the first and second items has been selected at the same 
time as the other of the first and second items, with the total number of times the 
one of the first and second items has been selected to produce a coincidence 
indicator, using the processor system, and 

d. inferring, using the processor system, a complementary rule 
between the two items when the coincidence indicator indicates coincident 
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selection of the Gist and second items at a level above a coincidence threshold 
level. . . , 

38. , A method as recited in claim 21 , wherein the processing system 
comprises a first set of processors connected to a computer network, and fiuther 
con:^}rising ^ . . ^ - . 

a. receiving, using the first set of processors, the sqjplicable data 
including . 

L the item recommendation data, and 
ii. the item compatibility rules, and 

b. modifying, using the first set of processors, the item 
recommendation data using the item compatibility rules to produce the 
compatibility-modified recommendadon ou^ut set. 

39. A method as recited in claim 38, wherein the processing system includes 
a second set of processors connected to the computer network, and fiirther comprising 
deriving the item compatibility rules, using the second set of processors. 

40. A method as recited in claim 38, further comprising deriving the item 
compatibility rules, using the first set of processors. 

41 . A computer-readable program storage device, having a set of program 
instructions physically embodied thereon, executable by a computer, to perform a 
method of producing a compatibility filtered and weighted reconunendadon, the method 
comprising: 

a. receiving applicable data including 

i. item recommendation data, and 

ii. item compatibility rules, and 

b. modifying the item recommendation data using the item 
compatibility rules to produce a compatibility-modified reconunendation output 
set 
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42. A storage device as recited in claim 41, the method fitither comprising 

a. receiving shopping data, i sv:- 

b. applying the item compatibility rules to the shopping data, and v 
" c. modifying the Item recommendation data, using the item 

compatibility rules applied to the shopping data, to produce the cornpatibUity'-"^^ 
modified recommendation output s^ S : : 

43 . A storage device as recited in claim 4 1 , further comprising 

a. receiving historical data. 

b. applying the item conqiatibility rules to the historical data, and 

c. modifying die item recommendation data using the itein 
compatibility rules applied to the historical data to produce the compatibility- 
modified reconunendation output set * 
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If a shopping set exists, add^all items that complement 
items in the shopping set to a new (empty) modlified"^ 
recommendation set. ! 






Add all Items from the original recommendation set to the 
modified recommendation set 
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Add all Items that complement items in the historical (if any) 
and original recommendation sets to the modified 
recommendation set 






Remove all items that are substitutes for items in the 
shopping set from the modified recommendation set 
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Pass through the modified recommendation set, removing 
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500 



510: Appfy_A_Rule 



INPOTSrRULE 

USES: NewRecommendationSet 
ITEM = RHS(Rule) 



IF {LOOKUP(nrEM.NewReconimendaaonSet) « NOTFOUND) 

InsertCNewReoommendationSet Item, NEUTRALSCORE) 

PTR « LOOKUP(ITEM.RECOMMENDATlONSET) , 

IF (Rule.Type = Compfement) . ' ' . 

PTR->Score += Rule->Dfm/aIue 
ELSE . 1 / 

PTR->Score-+ Rule->DiffValue ^ 




520: Method 



INPUTS: OrigtnalRecommendationSet ShoppingSet. HtstorySet. RuleSet 
OUTPUT: NewRecommendationSet - ^ - 

LOCAL: Usedltems a 0. Don»ltBma » 0 

NewRecommendationSet s capy(OrlglnalRecommendationSet) 

foreach Item in (ShoppingSet UNION HistorySel) 

if (LOOKUP(ltem, Usedltems) » NOTFOUND) 
ln3ert(Usedltems, Item) 
foreach Rule b RuIeSet 

if(HBm-«LHS(Rule}) 

ApplvLA-Rule (Rule) 

Sort (NewRecommendaUonSet) with numertcal KEY Score bi DESCENDING order 

foreach Item in NewRecommendationSet 

if ((Uem->Score >= RECTHRESHOLD) AND (LOOKUP(ltem. Usedltems) = NOTFOUND)) 
lnseft(Usedltem3. Item) 
Insertponeltems, Item) 
(breach Rule in RuleSet 

tf ((Kern = LHS(RuIe)) AND (LOOKUP(RHS(RULE). Doneltems) =^ NOTFOUND) 
Appty.A^Rule (Rule) 

Sort (NewRecommendationSet) with numerical KEY Score in DESCENDING order 
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Find the set of items compatible with the items in the match set 



Obtain recommendation scores for each item in the set 



Identify and recommend a subset of these items such that no 
item and its substitute are in the set and such that more highly 
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800 



810: Appfy.A.Rule 



INPUTS: RULE 

USES: NewRecommendattonSet 
ITEM » RHS(Riile) 



IF aOOKUP(rrEM,N8wR0Cor7vnendatiOffiSet) — NOTFOUND) 

lnsert(NewRecommendationSe(. ttem, NEUTRALSCORE) 

PTR » L00KUP(ITEM.REC0MMEN0AT1ONSED 
IF (Rule.Type Complement) 

PTR->Score ^ Rule->DifA/ahie 

ELSE 

PTR->ScofB-+ Rule->DifiValiio 



620: Method 



INPUTS: OriginalRecommendationSet, ShoppfngSet, HistorySet« RuleSet . r 

' OtJTPUT: NewRecommendationSet - 
LOCAL: Usedttems » 0. Ooneltems 

NewRecommendationSet « copy(OnginalReoommendationSet) 

fbreach Item fn (ShoppingSet UNION HUtoiySet) 

if (LOOKUPdtem. Usedttems) » NOTFOUND) 
lnseft(Usedltems. Item) 
foreach Rule in RuleS^ . 

Ef(ltem»LHS<Rule}) 

Apply^.Rute (Rule) 

Sort (NewRecommendationSet) with numerical KEY Score in DESCENDING order 

foreach Item in NewRecommendationSet 

ir((ltem->Score REGTHRESHOLD) AND (LOOKUP(ltem. Usedttems) NOTFOUND)) 
lnsert(Usedltems. ttem) 
lnsert(Ooneltems. Item) 
foreach Rule in RuleSet 

9 ((Item = LHS(Rule)} AND (LOOKUP(RHS(RULE), Doneltems) = NOTFOUND) 
Apply^.Rule (Rule) 

Sort (NewRecommendationSet) with numerical KEY Score in DESCENDING order 
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901 : Method far infefring substrtuto rules 

Foreach row from 1 to NUMITEMS 
Foreach column from rowf-l to NUMITEMS 

rf ((value(row. column] / TotalPurchases(row) < SubThreshold) 
AND 

(rotalPurch3ses(raw) > SubSignifnveshold)) 
then 

Add_Rule (row -> NOT column); 

if ((value[row,column] / TotalPurchase3(colufnn) < SubThreshold) 
AND 

(TotaIPurchases(column) > SubSigntfThreshotd)) 
then 

Add.Rule (column -> NOT row); 



902: Method for inferring complement rules 

Foreach row from 1 to NUMITEMS 

Foreach column from row+1 to NUMITEMS 

if ((value(row, column] / TotaIPurcha3es(row) > CompThreshotd) 
AND 

CTotalPurchases(row) > CompSigmfThreshoM)) 
then 

Add.Rule (row -> column); 

if ((value[row,column)/TotalPurcha8e8(cotijnin) > CompThreshotd) 
AND 

(TotaIPurchases(column) > CompSlgnifThreshold)) 
then 

Add.Rute (column •> row): 
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